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Testing the Foundations of Classical Entropy: Colloid Experiments 

Michael E. Cates*^’^, Vinothan N. Manoharan*^’^ 


Denning the entropy of classical particles raises a number of paradoxes and ambiguities, some of which have been known for 
over a century. Several, such as Gibbs’ paradox, involve the fact that classical particles are distinguishable, and in textbooks these 
are often ‘resolved’ by appeal to the quantum-mechanical indistinguishability of atoms or molecules of the same type. However, 
questions then remain of how to correctly define the entropy of large poly-atomic particles such as colloids in suspension, 
of which no two are exactly alike. By performing experiments on such colloids, one can establish that certain definitions of 
the classical entropy fit the data, while others in the literature do not. Specifically, the experimental facts point firmly to an 
‘informatic’ interpretation that dates back to Gibbs: entropy is determined by the number of microstates that we as observers 
choose to treat as equivalent when we identify a macrostate. This approach, unlike some others, can account for the existence of 
colloidal crystals, and for the observed abundances of colloidal clusters of different shapes. We also address some lesser-known 
paradoxes whereby the physics of colloidal assemblies, which ought to be purely classical, seems to involve quantum mechanics 
directly. The experimental symptoms of such involvement are predicted to be ‘isotope effects’ in which colloids with different 
inertial masses, but otherwise identical sizes and properties, show different aggregation statistics. These paradoxes are caused by 
focussing one’s attention on some classical degrees while neglecting others; when all are treated equally, all isotope effects are 


found to vanish. 

1 Introduction 

Understanding the phase behaviour of colloidal suspensions 
has been one of the crowning successes of classical statisti¬ 
cal mechanics. Their various equilibrium phases® can be pre¬ 
dicted by computing the Helmholtz free energy F(T^V^N) = 
E — TS for N particles in a volume V at temperature T. 

For hard spheres, the interaction energy E is zero and the 
entropy, S, is the sole determinant of the phase diagram. In 
many colloids the suspended particles have a hard core, a 
steric or electrostatic repulsion of short range compared to 
the size of the core, and negligible interaction at larger dis¬ 
tances. These indeed behave like hard spheres and their prop¬ 
erties confirm all aspects of the theoretical phase diagram for 
such spheres®. Adding attractions at larger distances compli¬ 
cates things (since E and S both matter) but the calculations 
can still be done, and agreement is just as impressive®. 

There are two puzzling niggles with this success. First: 
what happened to the solvent? The calculations are performed 
for particles with hard sphere (and/or other) interactions, as 
though they resided in a vacuum. Is it really true that the 
solvent can be ignored altogether, once the effective interac¬ 
tions between colloidal particles (which of course may depend 
on what the solvent is) have been worked out? Secondly, a 
colloidal suspension may contain, in a typical sample, of or¬ 
der 10^^ nearly spherical particles, each a micron in diameter. 
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Each of these particles contains in turn around 10^^ atoms. It 
follows that, if we allow for small variations in shape as well 
as in size, no two colloidal particles are exactly alike. Despite 
this, the phase diagrams observed for colloidal systems are the 
same as those calculated by statistical mechanics on the basis 
that the interacting particles concerned are indistinguishable. 

We address the issue of the ‘missing solvent’ later in this ar¬ 
ticle, but focus first on the apparent role of indistinguishabil¬ 
ity. Recall that this is a fundamentally quantum-mechanical 
concept, and applies only to particles that are molecularly 
identical. This does not hold for colloidal suspensions, for 
the reasons just given. Sethna has coined the term ‘undistin¬ 
guished’ particles for classical systems like these in which par¬ 
ticles could be distinguished, but in practice are not®. It seems 
deeply reasonable that undistinguished and indistinguishable 
particles should have the same thermodynamic behaviour, at 
least so long as one remains firmly in the domain of classical 
physics. Within this domain, fermions and bosons have the 
same statistics, and although factors of h might enter a calcu¬ 
lation, they should all cancel out in the end. Colloids are large 
enough to be classical in this sense. 

Such an equivalence seems particularly reasonable if one 
takes an ‘informatic’ definition® of the entropy S. In this 
informatic view, S = kplriW where W is the number of dis¬ 
tinct and equiprobable microstates that we choose to treat as 
equivalent when defining a macrostate. (Slightly more gen¬ 
erally, S = —kBY.Pi^^Pi where p; is the probability of mi¬ 
crostate i as determined within an ensemble of our choosing.) 
It follows that if we choose to make no distinction between 
colloidal particles—an attractive proposition for the experi¬ 
mentalist, who would likely prefer not to label each of the 
10^^ individual particles she can follow in her microscope— 





then all our calculations become the same as if there actually 
is no distinction. (In technical terms, the classical partition 
function for N labelled particles must always be divided by 
a factor Nl to account for permutations among themEEl this 
holds whether the particles are actually indistinguishable or 
merely ‘undistiguished’.) The informatic view thus neatly ex¬ 
plains why the statistical mechanics calculations capture the 
observed phase behaviour of colloidal suspensions. 

Intriguingly however, the equivalence of indistinguishable 
and undistinguished particles is not accepted by all interpre¬ 
tations of classical statistical mechanics. In particular there is 
one school of thought, most clearly elucidated in an influen¬ 
tial textbook by the distinguished physicist Shang-Keng Ma^^, 
that asserts that for the entropy of a system to be objectively 
real, it must be a dynamical quantity and not an informatic 
one. According to this ‘kinetic’ approach, S = kslnW where 
W measures the volume in phase space that the system can 
explore on the time scale of an experiment. The precise defi¬ 
nition of this time-scale dependent volume is problematic, as 
discussed carefully by Ma. (Specifically, only a tiny fraction 
of accessible states are ever sampled in practice.) Nonetheless 
one can sympathise with his view that the entropy ought to be 
a property of a thermodynamic system alone, and hence defin¬ 
able without reference to the informatic state of an observer. 
The ‘kinetic’ view of entropy has carried significant weight, 
for instance in the community working on glassesEI. 

The informatic and kinetic views of entropy would be in 
harmony if they always gave equivalent predictions for macro¬ 
scopic behaviour such as phase equilibria. However, they do 
not; and wherever this issue has been looked at carefully^K^, 
the informatic view has been found correct, and the kinetic 
one found wanting. 

This point is best illustrated by a colloidal experiment that 
has been done innumerable times in laboratories around the 
world. If a suspension of monodisperse hard colloidal spheres 
is prepared in a homogeneous fluid state at (say) a volume 
fraction (|) = 56%, this state will crystallize. (In the phase di¬ 
agram, this initial state lies in the metastable fluid but has a 
density below the glass transition. Crystallization is therefore 
rapid, and the identity of the equilibrium state as a colloidal 
crystal is unambiguous.) In the fluid, the spheres can easily 
swap places whereas in the crystal, they cannot. It is only 
a slight oversimplification to say that the diffusivity of the 
colloidal particles in the crystal is negligible, so that particle 
swaps are entirely absent on experimental time scale^ For 
indistinguishable particles, the entropy gain on transforming 
from liquid to crystal is extensive, and positive at this density: 
as is well known, the ordered structure has more entropy be- 


* Of course, colloid diffusivity is not entirely negligible in the crystal, nor is it 
so fast in the liquid as to explore all states on an experimental timescale. But 
nonetheless, the liquid samples vastly more permutations than the crystal on 
experimental timescales. 


cause particles have more room to wobble about when their 
mean positions are localized on a latticelS. 

However, within the kinetic approach, the additional en¬ 
tropy cost of localizing distinguishable particles onto un- 
swappable lattice sites contains a term Sperm = kB\n{N\) 
where N\ counts particle permutations. This term must be 
paid to collapse an accessible phase-space volume in which 
distinguishable particles can change places, into one where 
they cannot. This putative entropy cost is supra-extensive 
{ksNlnN) and thus for large N outweighs the extensive en¬ 
tropy on formation of the crystal. Thus the kinetic approach to 
entropy predicts that colloidal crystals are thermodynamically 
impossible. Yet they are observed every day. 

How could a theory get it so wrong? The mistake of the ki¬ 
netic approach is that it counts the states accessible to only one 
specific colloidal crystal (i.e., a single permutation of the col¬ 
loidal positions). But there are N\ distinct crystals that might 
arise, and the kinetic approach underestimates by this enor¬ 
mous factor the probability of finding the system in one or 
other of them. In the informatic approach, on the other hand, 
all the states that we as observers deem equivalent are counted 
as members of the same macrostate; the multiplicity of crys¬ 
tals with different particles occupying different sites then can¬ 
cels exactly Sperms recovering the same result as for indistin¬ 
guishable particles. Thus we correctly predict that at (|) = 56% 
(say) and A ^ oo, formation of some crystal or other occurs 
with probability one, even though formation of any specified 
realization of the crystal occurs with probability zero. The ki¬ 
netic approach can of course finesse this by adding on a ‘con¬ 
figurational entropy’ to count the number of mutually inac¬ 
cessible states®. But this concedes defeat: the original goal® 
was to show that entropy counts only the states the system 
can actually reach, whereas the configurational term directly 
adds back all those—within an equivalence class set by the 
observer’s choice of macrostate—that it can’t. For thermody¬ 
namic purposes, this simply restores the informatic definition 
of entropy. 

These arguments are not new®!! but deserve to be more 
widely known (and taught!). They illustrate two intercon¬ 
nected points. First, not all reasonable-sounding definitions 
of entropy for classically distinguishable particles are equiva¬ 
lent: some are right and some are wrong. Second, experiments 
on colloidal suspensions can resolve with striking clarity what 
the right definitions are. This adds to the many other ways in 
which colloidal experiments have clarified basic concepts in 
classical statistical mechanics®. 

In the rest of this article, we first reiterate the above dis¬ 
cussion from a slightly more formal angle (Section and 
then explore similar lines of reasoning in two further areas. 
In both of these, pitfalls in defining the classical entropy can 
be illuminated by laboratory experiments, or indeed thought- 
experiments, involving colloids. The two areas are the so- 





called ‘symmetry number’ in molecular partition functions 
(Section [^; and the paradoxical dependence of rotational en¬ 
tropies on particle masses (Section]^. Finally, in Sectionj^we 
return to the first of the two niggles raised above concerning 
the success of statistical mechanics: why is it that the entropy 
of a colloidal system can be computed as though the solvent 
were replaced by a vacuum? This will also resolve a further 
paradox involving the role of particle masses in translational, 
rather than rotational, entropies. 


2 Gibbs’ paradox and permutation entropy 


Classical statistical mechanics, as formulated by Gibbs^ZIrests 
on the formula F = —kBT\nZ{T,V,N) for the Helmholtz free 
energy, F. Here Z is the partition function, which after in¬ 
tegrating over momenta can be written for indistinguishable 
particles as 


Z = 
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In Eq. [^the symbol d denotes the dimension of space; P = 
IjkBT', and H is the classical (configurational) Hamiltonian 
written as a function of q, which is a JA^-dimensional vector 
of particle coordinates. Finally, ^Lparticie is a constant, which 
Gibbs could not calculate, but turns out to be the thermal de 
Broglie wavelength. 


^particle — ^ y ^particle^5^ 5 ( 2 ) 

where mparticie is the mass of the particle of interest, which 
might later be a single colloidal particle or a molecule. This 
correspondence is found by re-deriving Eq. as the semi- 
classical limit of the quantum partition function: this proce¬ 
dure gives an absolute determination of the integration mea¬ 
sure in the classical phase space whose integration over mo¬ 
menta yields the X factors in Eq. 

By definition, X (which involves h) should cancel from any 
physical observable that involves only classical physics. Its 
apparent failure to do so—in calculations that are classical, 
but not quite correct—lies behind some of the paradoxes dis¬ 
cussed later. But first let us focus on indistinguishability. 

Gibbs was fully aware that for distinguishable particles the 
N\ divisor in Eq.l^is in principle absent, and that this absence 
destroys thermodynamics as we know it^ZI. For instance, with¬ 
out this divisor the entropy of an ideal gas is supra-extensive: 

SiG{N,V)/kB^N\n{V/NX^) FNlnN (3) 


Gibbs predated quantum mechanics, but understood (for in¬ 
stance) that all helium atoms are equivalent, hence requiring 
inclusion of the N\ divisor, which restores extensivity by can¬ 
celling the second term. Thus the observed extensivity of the 


thermodynamic entropy in atomic and molecular substances 
was no surprise to him. 

He did however pose the following question. Suppose 
we have two types of particle (red and blue) each indistin¬ 
guishable among themselves, for which SiG{Nr,Nb,V)/kB — 
NrlniV/NrV^) +Nbln{V/NhX‘^). This is not equal to SiG{Nr + 
Nb,V) for a single species. A paradox now arises if one imag- 
ines red and blue particles to smoothly and continuously be¬ 
come merged into a single population of purple particles. How 
and when does the entropy jump from one formula to another? 
This is Gibbs’ paradox, and one resolution of it is offered 
by quantum mechanics: you cannot smoothly transmute one 
chemical species into another, so ‘red is red and blue is blue 
and ne’er the twain shall meet’. This resolution asserts that 
the problem is a mere artefact of classical thinking. 


Gibbs himself found a different resolution which, unlike 
the quantum-mechanical one, makes sense even for classically 
distinguishable particles such as colloids (which could in ef¬ 
fect be made in a continuous range of colours, if one so de¬ 
sired). He considered how the probabilities of different collec¬ 
tions of states would change if the observer chose to ‘undis¬ 
tinguish’ specific subsets of such particles. This act merges 
previously distinct macrostates, whose probabilities therefore 
must be added together. Gibbs found that the entropy switches 
from one form to another at precisely the point where we 
choose to give up distinguishing red particles from blue. His 
general analysis of this class of problems remains useful to¬ 
day, for example when considering colloids with a continuous 
distribution of sizesEl. And, in the case where all particles are 
undistinguished, the final result is simple: the Nl divisor reap¬ 
pears in Eq. and extensive, single-species thermodynamics 
is restored. 


Thus, although quantum indistinguishability offers a fast 
and convenient derivation of the A^! divisor in Eq. it is 
quite wrong to believe that this factor defies classical expla¬ 
nation. While many others have noted this fallacy, most re¬ 
cently Frenkel® the belief is still widespread (and the sup¬ 
posed breakdown of classical thinking itself often confus¬ 
ingly referred to as the ‘Gibbs paradox’). The cause of the 
misunderstanding is perhaps that most of us learn statistical 
physics from textbooks that rely solely on the quantum me¬ 
chanical explanation of the A^! divisor. In a textbook con¬ 
text - where atoms and molecules are typically the main fo¬ 
cus (e.g.®) - this represents sound pedagogy; but the result 
is that many physicists remain unaware of Gibbs’ completely 
classical derivation of the same factor. Indeed it seems that his 
derivation had been almost entirely forgotten before its exca¬ 
vation by Jaynes about 20 years ago®. 
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Fig. 1 Optical microscope images (left) and structures (middle) of 
tri-tetrahedral and octahedral colloidal molecules. Each of these two 
isomers contains six micrometer-scale polystyrene spheres bound 
together by depletion forces, which are induced by nanoparticles 
that cannot be seen in the micrographs. The depletion attraction, 
details of which are reported in^^, has a depth of about A ksT and a 
range of about 80 nm, much smaller than the size of the polystyrene 
spheres. Experiments show that in an equilibrium ensemble, the 
probability of observing a tri-tetrahedron is 96%, compared to 4% 
for the octahedron. The difference in probabilities is dominated by 
rotational entropy, which is a function of the symmetry number a 
(right). (Images from Guangnan Meng.) 


3 Colloidal molecules: entropy and symmetry 
numbers 

Perhaps the simplest illustration of Gibbs’ argument— 
and of how our experiment defines the macrostate un¬ 
der observation—comes from experiments on ‘colloidal 
molecules’: small clusters of micrometer-scale spherical par¬ 
ticles that attract one another over a short distance. The 
short range of the attraction means that, to a good approxi¬ 
mation, the potential energy of a colloidal molecule is pro¬ 
portional to how many ‘bonds’ (pairs of touching particles) it 
has. Molecules with different structures but equivalent num¬ 
bers of particles are called ‘isomers.’ In three-dimensions, six 
spheres can form two isomers with 12 bonds, an octahedron 
and a tri-tetrahedron^^ (Figure [^. Yet experiments show that 
the tri-tetrahedron occurs 24 times as often as its more sym¬ 
metric isomer, the octahedronCSl. 

The preponderance of the tri-tetrahedron cannot be ex¬ 
plained away by appeal to which structure is more likely 
to form first, since the isomers can freely interconvert over 
the timescale of its experiment. Having ruled out kinetics 
and potential energy as reasons for the dominance of the tri¬ 
tetrahedron, we must conclude that the tri-tetrahedron has a 
higher entropy than the octahedron. 

Where does this entropy difference come from? We shall 


show, using the same statistical mechanical formalism used 
for moleculesEl, that the dominant factor is the difference in 
symmetry between the two structures. For simplicity we sup¬ 
pose our classical colloidal ‘molecule’ to be in vacuo (the 
role of a solvent is considered in Section [^. In equilib¬ 
rium, the probability P of observing an isomer is proportional 
to where U is the potential energy of the isomer 

(which depends only on its bond number) and Zmoi, its molec¬ 
ular partition function. To a good approximation, Zmoi can be 
factored into translational (T), rotational (/?), and vibrational 
(V) parts: 

^mol = (4) 

The translational part, when converted to a free energy, yields 
the ideal gas entropy defined above. It is the same for both 
isomers, assuming the box containing them is large compared 
to their dimensions: 


Zr=V/^Llecule- (5) 


The vibrational part can be calculated by assuming harmonic 
interactions and taking the product of classical-limit contribu¬ 
tions from the normal mode frequencies CO/: 


Zy = 


3A^-6 
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( 6 ) 


When this calculation is done, the lower-frequency vibrational 
modes in the tri-tetrahedron lead to its being favoured by a 
factor slightly smaller than two. 

We are still off by a factor of approximately 12, which must 
come from the rotational contribution. In three dimensions, 
the classical-limit rotational partition function is 

^ n^/^{2kBT)y^ VTJih 

^-5^ 

where /i^2,3 are the three principal moments of inertia of the 
molecule (more on these in Section]^ and a is the symmetry 
number, defined as the number of ways that a molecule can 
be rotated and still look the same. The octahedron, a Platonic 
solid, has a symmetry number of 24, while the tri-tetrahedron, 
with only one two-fold axis of rotational symmetry, has a sym¬ 
metry number of 2. The ratio of 12 between these symme¬ 
try numbers, taken together with the factor close to two from 
vibrational contributions and another close to unity from the 
moments of inertia, yields the final 24-fold difference in prob¬ 
ability. 

Though it is reassuring that the calculation reproduces the 
experimental results, it sheds little light on how the symmetry 
of the octahedron could work against it so strongly. The usual 
tactic to make sense of such results is to appeal to quantum 
mechanics. There the appearance of the symmetry number 
in the partition function makes perfect sense: the molecular 











•V - V n^u 


:: - * ^ V ;; - 4 ^ 

Fig. 2 The symmetry number accounts for the relation between permutations and rotations. A) In this example, four particles come together 
to form one of two isomers, a rhombus (top) or a square (bottom). We imagine each cluster to be confined to the two-dimensional plane, so 
that there is only one rotational axis, which points out of the plane. Any given orientation of each isomer can be constructed from 4! = 24 
permutations of particles. B) For the rhombus, which has two-fold symmetry in the plane, each configuration of labeled particles (top) is 
equivalent to a permutation of particles followed by a rotation of 7Z radians (bottom). C) For the square, which has four-fold symmetry in the 
plane, each configuration can be made in four different ways, corresponding to permutation plus a rotation of 7i/2, k, or STijl radians. 


wave function has a symmetry determined by the placement 
of atoms in the molecule, so that rotations commensurate with 
this symmetry are fundamentally indistinguishable. If we did 
not include the symmetry number, we would overcount the 
number of rotational microstates. And indeed this is where 
many textbooks^! leave the matter. 

But this explanation is wholly unsatisfying for colloidal 
molecules, where the wavefunction, were we even able to 
compute one, would not be symmetric unless each of our par¬ 
ticles were composed of exactly the same number and config¬ 
uration of atoms. Since that is certainly not the case, and the 
particles can in principle be distinguished—by small differ¬ 
ences in their size, for example—we must seek an alternative 
explanation. 

To do so, we return to the original deriva tion o f the symme¬ 
try number by Ehrenfest and Trkal in I 92 lE^ESl which made 
no recourse to wavefunctions or quantum mechanics in gen¬ 
eral. We illustrate this argument with a simple example in¬ 
spired by Gilson and Irikural^H (see alsoES). 

Consider a colloidal molecule with N = 4 particles that are 
constrained to two dimensions (Figure]^. There are 4! = 24 
possible ways they can be arranged to form a four-particle 
molecule, for example a rhombus or a square. Writing the 
partition function in terms of the coordinates of the particles 
(or ‘atoms’) and integrating out the momenta yields 

Zatom = (^1 • • • ‘I”)] dqi...dq„. (8) 


The integral extends over all configurations in which the atoms 
form the molecule of interest. Because the particles are undis¬ 
tinguished, each configuration can be made in A^! = 4! = 24 
different ways, and so we divide by A^!. 

Why does the symmetry number appear in Zmoi (Eq. 

Eq. 1^ and not in Zatom (Eq- And why does a factor of 
1/A^! appear in Zatom and not in Zmoi? The difference is that 
Zmoi is integrated over molecular coordinates. In writing Eq.|^ 
we assumed that our colloidal molecule is a rigid body that 
can translate, rotate, and vibrate. 

In molecular coordinates, permutations and rotations are 
not independent operations but become ‘entangled’ (in the 
classical sense of that word!). To see this, we distinguish the 
particles and assign them colours, as shown in Figure In 
the distinguished system, the rotational partition function is 
proportional to the number of permutations times the number 
of possible orientations of the cluster: 4! • 2n. But sometimes 
the same configuration can be made in different ways. For 
the rhombus, which has two-fold symmetry in the plane, each 
configuration of labeled particles (Figure |^, top) can also be 
made by permuting the particles and rotating the cluster by 7Z 
radians (Figure]^, bottom). The rotational partition function 
is therefore proportional to 4 ! • tt or 4 ! • 2;r/a, where a = 2. For 
the square, which has four-fold symmetry in the plane, each 
configuration can be made in four different ways, correspond¬ 
ing to permutation plus rotation of 7r/2 radians, or an integer 
multiple thereof (Figure [^). The rotational partition function 
is therefore proportional to 4! • 7r/2 or 4! • 27r/a, where a = 4. 













If, as in the experiment, the particles are undistinguished, 
we must divide by A^! =4! in both cases, leaving a rotational 
partition function that is proportional to 2;r/a. We now see 
why the symmetry number appears in Zmoi and not Zatom, and 
vice versa for the 1/A^! term: both changes result from group¬ 
ing together the atomic degrees of freedom. The proportions 
of the two isomers observed in an equilibrium ensemble will 
depend inversely on the ratio of their symmetry numbers, as 
well as on the differences in potential energy, vibrational en¬ 
tropy, and moments of inertia. (We will see in the next Section 
that there are some crucial cancellations between the moments 
of inertia and the vibrational terms.) The same argument ap¬ 
plies to the octahedral and tri-tetrahedral colloidal molecules 
observed in the experiments. 

What if we chose to distinguish the colloidal particles in 
the experiment, for example by labeling them with different 
fluorescent colours? In that case it would be natural to con¬ 
sider each different arrangement of coloured particles to be a 
different molecule. There are 30 arrangements for the octa¬ 
hedron (6! /a, where a = 24), and 360 for the tri-tetrahedron 
(a = 2). If we were to count how often we saw each of these 
isomers, we would And that each of the 360 tri-tetrahedral iso¬ 
mers would occur twice as often as each of the 30 octahedral 
isomers, because of the ratios of moments of inertia and vibra¬ 
tional frequencies. It is only when we lump these macrostates 
together—by ignoring the distinctions between particles—that 
we obtain a result that depends on symmetry numbers. 

It is no coincidence that this argument is similar to that 
made by Gibbs in resolving the paradox now named after him. 
The aim of Ehrenfest and Trkal was in fact to to understand 
the origin of the A^! divisor in the canonical partition function, 
the very same factor that we discussed in Section The only 
way to understand how the entropy of a gas depends on the 
number of molecules, Ehrenfest and Trkal argued, is to con¬ 
sider a situation where the number of molecules N can vary 
in a reversible process. Within the canonical ensemble, N is 
flxed when the system contains only a single species, and we 
cannot add more molecules reversibly. But when there are 
multiple species of molecules in the same system that can in¬ 
terconvert, their numbers Nt may vary reversibly. In this case, 
factors of Nt ! appear in the partition function without any ap¬ 
peal to quantum mechanical argument. The symmetry number 
appears as a side-note in this thought experiment. It is a histor¬ 
ical irony that most modem textbooks ascribe to it a quantum 
origin, given that Ehrenfest and Trkal aimed to show exactly 
the opposite (see®! and^l for elegant and modern reformula¬ 
tions of their arguments). 

The broader point here is that our statistical mechanical 
models must be consistent with the types of observation we 
make, since those observations define the macrostate to be 
modeled. Consider, for example, a flexible colloidal molecule 
that can fluctuate between symmetric and asymmetric confor- 
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Fig. 3 Left, a flexible linear molecule that can fluctuate between 
high-symmetry (top) and low-symmetry (middle, bottom) 
conformations without changing its bond network. Right, a 
symmetric isomer. If our experiment does not distinguish between 
the various states on the left and only counts the abundance of any 
conformation on the left versus the one on the right, we must assign 
a symmetry number of 2 to the flexible molecule, even though it 
spends most of its time in asymmetric conformations. 

mations without changing its bond topology (Eigurej^. Does 
such a molecule have a symmetry number, given that it spends 
most of the time in asymmetric conformations? The answer 
depends on what we observe. If our experiment measures 
only the concentration of this molecule relative to other iso¬ 
mers, then the symmetry number must appear in our calcula¬ 
tion, because it accounts for how identical conformations can 
be reached by permuting particles followed by either rotation 
or flexin^2II xhis example shows that the symmetry number 
is more generally understood as a property of the topology of 
the bond network of a molecule rather than its geometry. This 
may seem like a deep statement, but it is really a deflnition that 
follows from what experiments typically measure (and what 
they do not). Put differently, we have chosen to treat all three 
states of the chain in Eig. as states of the same molecule, 
not different molecules, and we must calculate the symmetry 
number accordingly. 

4 Colloidal entropies are mass-independent 

As already discussed, the relative abundance of different col¬ 
loidal ‘molecules’ should be proportional to the partition func¬ 
tion for each type. The partition function of a molecule in¬ 
cludes the symmetry number as just described, but also fac¬ 
tors counting the number of translational, vibrational and ro¬ 
tational states. In a quantum context, it is conventional to con¬ 
sider each of these factors separately - in part because in many 
molecular systems at room temperature rotations are almost 
classical, while vibrations are not. 

When used to address classical entropies, this artiflcial sep¬ 
aration leads to another paradox. (Recall that a paradox is an 
apparent contradiction that, on close inspection, disappears.) 
Let us consider the rotational contribution to its partition func¬ 
tion which in three dimensions is Eq. |7] Eor the simplest case 
of a diatomic molecule, deriving this result is a standard un¬ 
dergraduate exercise: one examines the small [3 limit of the 




quantum partition function Z = £^^(2^ + 1) exp(—13£'„) where 
En = h^n{n + l)/2/ is the rotational energy and {2n + 1) the 
number of distinct quantum states of that energy. Eq. |7] can 
be derived by generalizing this quantum calculation, or by a 
purely classical integral over the canonical coordinates for a 
rigid rotor. 

The paradox is as follows. Imagine we have two species 
of colloids of the same size and interactions but with two dif¬ 
ferent particle masses. For instance, the two types could com¬ 
prise inner spheres of gold and of aluminium, each coated with 
an outer layer of polystyrene so as to create the same final size 
and surface chemistry. For simplicity ignore gravity (assume 
the experiment to be done in the space station), and consider 
‘triatomic’ linear molecules that contain one gold and two alu¬ 
minium particles. Then according to Eq. the gold particle 
is more likely to be found in either one of the edge positions 
than in the middle position. More generally, given two species 
of particles, placing the heavy ones at the periphery of the 
molecule increases the moment of inertia and hence the par¬ 
tition function. According to Eq.|7]this should directly infiu- 
ence the abundances of these different configurations, favour¬ 
ing those with heavy particles outermost. In atomic physics 
this would be called an ‘isotope effect’. 

Can this really be true? A thought-experiment says no: col¬ 
loids explore their configuration space by over-damped Brow¬ 
nian motion in which inertia is negligible, so how can the iner¬ 
tial mass possibly control the abundances of different cluster 
geometries? The paradox was raised in a commentary by one 
of us®, with the tentative suggestion that Eq.[^ might fail for 
particles embedded in a molecular solvent rather than a vac¬ 
uum (see Section!^ below). But in fac t the resolution of this 
paradox is much simpler than thatlSESI ‘colloidal isotope 
effect’ is a mirage, caused by artificially separating classical 
rotations from vibrations and translations. 

It is true that for a molecule in vacuo the full classical parti¬ 
tion function is usually approximated by the factorized form, 
Eq.g But what matters is whether this object, not just one 
of its factors, supports an isotope effect. It doesn’t, as we can 
see by sidestepping the above factorization and using instead 
a more fundamental ‘interacting atom’ representation: 

Z = Jexp[-^{HT+HR + Hv)]dpdq 

= j exp [-P (Y.Pi/'^mi + t/(q))] dpdq 

= ZkZc (9) 

Here Zk and Zc are the kinetic and configurational contribu¬ 
tions arising from the p and q integrals, and U (q) is the poten¬ 
tial part of the Hamiltonian. Because the p and q integrals are 
separable, and because we assumed by hypothesis that U (q) is 
mass-independent, the probability of observing different con¬ 
figurations of the particles is fixed solely by their interactions. 


and not by their masses. Eq. [^is written down for point par¬ 
ticles; in principle extended objects such as colloidal spheres 
will have a further factor from the rotational kinetic energy of 
the spheres themselves, but this is again factorable and makes 
no difference to the argument. 

How does this outcome square with the ‘molecular’ rep¬ 
resentation, Eq. ^ For a classical molecule of N atoms— 
assuming harmonic vibrational states and no vibration- 
rotation coupling—the molecular partition function (in J = 3) 
follows from Eqs. EHZl 


^ y n^/^{2kBT)y^V7^^^'’kBT 

Zmol = - 13 - -- I I 77 - (Ifi) 

^Llecule ^ ^ i=l 


where the CO/ are the angular frequencies of the vibrational 
states. The particle mass ratios enter not only the /’s but also 
the go’s; and an exact cancellation between these two factors - 
while far from ob viou s in this representation - is completely 
guaranteed by Eq. |^3. 


5 Integrating out the solvent 

Let us finally return to the first of the two niggles mentioned in 
the introduction concerning the success of statistical mechan¬ 
ics: the fact that colloids move through a solvent, not empty 
space. To see what the problem is, consider the quantum sta¬ 
tistical mechanics of a dilute atomic gas. The ideal gas con¬ 
tribution to the entropy (after allowing for the N\ divisor in 
Eq.[^ is 


S,G=NkB\n^ -+ (11) 

^^particle V2 ) 

As is well known, the factors of X generally cancel out in 
the entropy differences that control phase behaviour - specif¬ 
ically, when comparing states with the same number of trans¬ 
lational degrees of freedom, such as a liquid and a gas of the 
same chemical species. Suppose however that our particles 
can dimerize, forming a rigid bond of binding energy A. Then 
one finds that the equilibrium constant relating the concentra¬ 
tions of dimers (D) and monomers (M) obeys 

K=^= exp[pA]. (12) 

This is a simple application of the Boltzmann distribution; it 
shows that where processes are present that can change the 
number of degrees of freedom, quantum contributions to the 
ideal-gas entropy play a role. 

Let’s now address colloids in a solvent. A good starting 
point is the full semi-classical partition function for all parti¬ 
cles present, in which we retain the Nd colloid coordinates q 









but integrate out the solvent ones Q. Integrating also over all 
momenta as usual, we have 

Z(p,q) = —-4rf— / exp[-|3//(p,q,Q)] JQ = exp[-p[/(q)] 

'Solvent 

(13) 

where M the number of solvent molecules®. The second form 
defines the effective interaction potential of the colloids U (q). 
Eq.[^is, of course, another example of strategically discard¬ 
ing information (the solvent coordinates) that under other cir¬ 
cumstances we might have chosen to retain. 

So long as we can determine a good approximation for 
t/(q), then the solvent has indeed gone away; our colloids 
might as well be in vacuo, so long as this effective interaction 
replaces the one they would really have had there. The effec¬ 
tive interaction potential can include solvation forces and all 
manner of other solvent-dependent interactions; nonetheless, 
all that we need to know about the solvent is encoded in U (q). 

The paradox lies in the continuation of this argument. The 
colloid free energy is now F{T,V,N) = —ksTlnZ where 

^ " Mnld [ [-^^(<1)] dq (14) 

^ "^colloid 


This still contains the thermal de Broglie wavelength of the 
colloids, A^coiioid- It might appear then that if our potential 
U (q) has a short range deep attraction, conventionally repre¬ 
sented by a bond energy A, Eg. will still apply. If so, the rel¬ 
ative populations of colloidal dimers (for instance in our mix¬ 
ture of gold-cored and aluminium-cored colloids with identi¬ 
cal interactions) depends explicitly on their particle masses. 
This seems very wrong, for the same reasons as discussed in 
the previous section when comparing relative abundances of 
different cluster shapes. What is more, the actual value of K 
seemingly involves h even though we ought to be dealing with 
purely classical physics here®. 

One resolution sometimes offered is that, as the solvent gets 
integrated out, the effective phase-space measure for the col¬ 
loids - which roughly defines how far you have to move a 
colloid before it counts as being in a ‘different’ configuration, 
becomes set not by X but by a coarse-grained length-scale X 
related to the solvent diametei^SI. This is, for example, how 
the world might appear to a lattice modeller where the solvent 
size appears to set a natural discretization scale. The classical 
quantity X is then postulated ad-hoc to replace X in Eq. 14 


and hence in Eq. 12 and all similar results for formation of 
supra-dimeric clusters. 

But in fact this is a specious argument, for reasons spelled 
out below. Instead the astute reader will have noticed that the 
paradox is based on the same flawed reasoning as the one dis¬ 
cussed in the previous section: we have treated some degrees 
of freedom as classical, but not all. Specifically, we assumed 
that the binding energy A of a colloidal dimer was connected 


with formation of a fixed bond - ignoring the fact that, classi¬ 
cally, all bonds have a vibrational entropy. Referring again to 
Eq. it is once again clear that - because masses only enter 
the momentum integral in the partition function, which is sep¬ 
arable - all masses must cancel, as must h, once the full set of 
classical degrees of freedom is treated on an equal footing. 

The way this happens for colloidal bonding is easiest seen 
for the case of a square well potential, of depth A and range 1. 
We treat for simplicity the case of J = 1, for which rotations do 
not enter. However small ^ may be, in the classical limit there 
is a finite entropy of confinement for the relative coordinate 
between the two particles in our dimer; and for the square well 
this is simply Shnnd = ^ 5 ln(^/)L). The equilibrium constant 


is now (using Eq. 12 for J = 1) ^ = )LV^exp[PA + 5'^o„j] = 


^\/2exp[PA]. Thus the equilibrium constant is independent 
of quantum mechanics and there is, as promised, no isotope 
effect. 

We now see why the replacement of X with X did not offer 
a true resolution to the paradox. If the physical behaviour is 
classical, none of the actual results can depend on X\ so replac¬ 
ing X with X can make no difference unless the calculations 
have been wrongly executed. As the above example shows, 
the length that replaces X in (say) the dimerization constant 


K of Eq. 12 is not some ad-hoc coarse-graining scale X\ it is 


instead a precisely defined length that can be calculated di¬ 
rectly from the effective interaction U (q). And in our chosen 
example, it is simply the range of the bonding interaction, 1. 

In summary, for classical systems such as colloids, the abso¬ 
lute phase-space measure as set by quantum mechanics must 
cancel from any observable physical quantity. This remains 
just as true after integrating out the solvent (to get an effec¬ 
tive interaction f/(q)) as it was before doing so. It is there¬ 
fore never wrong to use for the colloid partition function the 
measure set by the semi-classical limit of quantum mechan¬ 
ics, in which factors of the thermal de Broglie wavelength X 
appear, Eq. But if such factors fail to cancel in any pre¬ 
dicted observable, this is because a mistake has been made. 
The most likely pitfall is to inadvertently treat some of the 
classical degrees of freedom as frozen. (Indeed, freezing a 
classical degree of freedom carries an infinite classical entropy 
cost, which is cut off only by quantum mechanics.) Because 
the phase-space measure must cancel, replacing X with a clas¬ 
sical coarse-graining length such as a solvent size, while it 
may disguise an incorrect calculation, cannot change a correct 
one. 


6 Conclusion 

A century of quantum mechanics has had a profound infiuence 
on the way we think about statistical physics. The paradoxes 
and ambiguities we have discussed all arise from assumptions 
and explanations based on the quantum viewpoint. Sometimes 











these assumptions are so deeply embedded in the formalism 
that we forget they are there. For example, the vibrations of 
most molecules are quantized even at room temperature; we 
would get nonsense if we interpreted molecular spectra us¬ 
ing a classical formalism. Consequently, a textbook might not 
even consider the classical limit of the vibrational entropy. But 
only by taking this limit can we understand why the thermal 
wavelength—an absurdly small lengthscale for a macroscopic 
object like a colloidal particle—cancels out in the equilibrium 
constant for dimerization of such objects. 

In other cases, assumptions carried over from quantum me¬ 
chanics are mostly harmless, but not if they cause one to for¬ 
get that the same results can also be justified classically. For 
example, there is little danger in assuming that colloidal par¬ 
ticles are indistinguishable, since most experiments choose to 
leave them undistinguished, which gives equivalent results in 
the classical limit. Danger does lie in arguing that because 
colloids are distinguishable in principle, theory can be im¬ 
proved by treating them as distinguished in statistical mechan¬ 
ics. By defining macrostates far too narrowly, that line of 
thinking leads to predictions that are not borne out by exper¬ 
iments: colloids would never crystallize, and symmetric col¬ 
loidal molecules would have the same rotational entropy as 
asymmetric ones. 

Experiments on colloids have helped to resolve other para¬ 
doxes as well. The oldest and most famous of these is 
Maxwell’s demon. In the 1980s Landauer and Bennett ‘ex¬ 
orcised’ the demon by showing that erasing classical informa¬ 
tion carries an entropy cosJ^l. But for decades afterward it was 
not unusual to find articlesl^ claiming that the demon must 
produce entropy when it makes a measurement. As Bennett 
notedly, the tendency to focus on the entropy cost of mea¬ 
surement, rather than of erasure, may ‘have been a side ef¬ 
fect of the great success of quantum mechanics.’ The question 
has been settled by recent experiments on colloidal particles, 
which show that the cost of erasing information agrees with 
Landauer’s prediction®. 

These experiments and the others we have mentioned all 
support the informatic view of entropy. The main argument 
against this view is that it introduces subjectivity into the def¬ 
inition of the entropy. This is true, but we see it as a strength, 
not a weakness. We use the term ‘subjective’ in the same 
sense as Jaynes® did: ‘depending on the observer.’ For clas¬ 
sical systems such as colloids, the observer has a choice of 
what to observe and what to ignore; for example, she can 
treat each different arrangement of six fluorescent particles as 
a different molecule, or she can ignore the colours and keep 
track of only the bonds. The macrostate therefore depends 
on the observer’s choice. So, too, does the entropy, which 
is found by counting the number of microstates that make 
up this macrostate. It is possible to define the entropy non- 
subjectively—for example, by insisting that colloids always 


be treated as distinguishable—but we have seen that such a 
definition makes it difficult to reconcile theory with experi¬ 
ment. 

A subjective entropy might appear to create new problems. 
After all, the heat transferred in a reversible process is pro¬ 
portional to the change in entropy. If the entropy depends on 
the observer, how can a measurement of the heat be consis¬ 
tent from observer to observer? We note first that experiments 
can measure only entropy differences, not absolute entropies. 
Each observer is free to add an arbitrary (subjective) constant 
to the entropy, and even if each chooses a different constant, 
the measurements are unaffected. But what if the heat were 
measured directly, for example by measuring the motion of 
the particles with an optical microscope? Would the heat flow 
really depend on the choices of the observer? Perhaps sur¬ 
prisingly, the answer is yes, because the observer can choose 
which degrees of freedom to measure and which to ignore. In 
any reversible change, the energy change associated with de¬ 
grees of freedom that are measured is called work; the remain¬ 
der is called heat. The first law of thermodynamics (which 
states that the sum of heat and work is the change of inter¬ 
nal energy) then directly requires that the heat flow depends 
on which degrees of freedom are retained as state variables, 
and which are ignored. But if each observer makes the same 
choice, the heat measured will be the same from observer to 
observer—and in that sense it remains an objective quantity. 

Thus we would argue that the informatic view is the sim¬ 
plest way to interpret experiments on colloids. As long as we 
clearly specify our choices, all paradoxes vanish. The beauty 
of colloidal systems is that the particles are fundamentally 
classical and distinguishable in principle. This allow us con¬ 
sciously to make choices about the macrostate in more than 
one way, and to observe and compare the results. In so doing, 
we gain a better understanding of Gibbs’ arguments and the 
effects of entropy in the macroscopic world. 
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